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INPUT NEW MPEG-2 FILE AND 
CREATE REDUCED-QUALITY 
MPEG FILE AS AVAILABLE 
RESOURCES PERMIT 




BROWSE THROUGH 
REDUCED-QUALITY 
MPEG FILE TO SELECT 
IN-POINTS AND 
OUT-POINTS OF CLIPS 
TO BE SPLICED 



56 



STREAM COMPRESSED 
VIDEO FROM REDUCED 
QUALITY MPEG FILE 
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STREAM ORIGINAL QUALITY l-FRAMES 
AND 3 FREEZE FRAMES PER l-FRAME 




YES 



STREAM ORIGINAL 
QUALITY MPEG-2 
CODED VIDEO 




SELECT 1 OR 2 FREEZE FRAMES PER 
l-FRAME FOR DESIRED SPEED-UP 
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STREAM REDUCED- 
AND INSERTED FRE 


QUALITY l-FRAMES 
EZE FRAMES 
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( MPEG SPLICING ) 



INPUT DESIRED END FRAME OF FIRST CLIP AND 
DESIRED START FRAME OF SECOND CLIP 



7- 



121 



FIND CLOSEST I FRAME PRECEDING DESIRED START 
FRAME TO BE THE IN-POINT FOR SPLICING 



— 122 



ADJUST CONTENT OF THE FIRST CLIP NEAR THE END 
FRAME OF THE FIRST CLIP AND ADJUST CONTENT OF 
THE SECOND CLIP NEAR THE IN POINT IN ORDER TO 
REDUCE PRESENTATION DISCONTINUITY AND PREVENT 
DECODER BUFFER OVERFLOW WHEN DECODING 
THE SPLICED MPEG STREAM 
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RE-FORMATTING INCLUDING RE-STAMPING OF 
PTS, DTS AND PCR'S FOR AUDIO AND VIDEO 



— 124 
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( SEAMLESS VIDEO SPLICING ) 



141 



ANCHOR THE FIRST DTS OF THE SECOND CLIP 
AT ONE FRAME INTERVAL LATER THAN THE 
LAST DTS OF THE FIRST CLIP TO PREVENT 
VIDEO DECODING DISCONTINUITY 



DOES 

142-^ ^ THE PCR 

EXTRAPOLATED TO 
THE BEGINNING FRAME OF THE 
SECOND CLIP FALL JUST 
AFTER THE ENDING 
TIME OF THE FIRST 
CLIP 
? 

NO 



YES 



ADJUST THE CONTENT OF THE 
FIRST CLIP SO THAT THE PCR 
EXTRAPOLATED TO THE 
143— \ BEGINNING FRAME OF THE 
SECOND CLIP FALLS JUST 
AFTER THE ENDING TIME OF 
THE FIRST CLIP 



( END ) 



Fig. 4 
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VIDEO SPLICING 
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DETERMINE THE LAST DTS/PTS OF THE FIRST CLIP 

(DTS M ) 



— 151 



DETERMINE THE TIME OF ARRIVAL ( Te ) 
OF THE LAST BYTE OF THE FIRST CLIP 
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ADD ONE FRAME INTERVAL TO DTS L 1 
TO FIND THE DESIRED FIRST DTS 
LOCATION FOR THE SECOND CLIP 
( DTS F 1 =DTS L1 +1/FR ) 



153 



KEEPING THE DTS-PCRe RELATION UNALTERED 
FOR THE SECOND CLIP, FIND THE TIME INSTANT 
Ts AT WHICH THE FIRST BYTE OF THE SECOND 
CLIP SHOULD ARRIVE 
( T START =DTS F 2 -PCR e2 ) 

(Ts =DTSfi -T start ) 
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YES 



INSERT NULL TS PACKETS TO 
COMPENSATE FOR THE GAP 
BETWEEN T e ANDTs 



G,= Hi 



T e ) ( BIT RATE ) 
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158 



OPEN UP A CERTAIN AMOUNT OF SPACE 
IN THE FIRST CLIP TO ACHIEVE 
8 

T S =T e 



BIT RATE 



THE NUMBER OF BYTES TO DROP IS 
( T e - T S ) ( BIT RATE ) 



1 + 



8 



IF POSSIBLE, REMOVE NULL PACKETS TO 
DROP THE BYTES, OTHERWISE, REPLACE 
ONE OR MORE FRAMES AT THE END OF 
THE FIRST CLIP WITH CORRESPONDING 
REDUCED-QUALITY FRAMES. 



159 



CONCATENATE 
THE STREAMS 
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COMPUTE THE VIDEO TIME 
STAMP OFFSET V OFFSET 



END ) 
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( TRICK MODE AUDIO ALIGNMENT ) 
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BEGIN NEXT APU 



YES 
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YES 
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INCREMENT 
APU POINTER 
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YES 
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ADVANCE APU POINTER TO THE FIRST 
APU BEGINNING IN THE DURATION OF 
THE VPU OF THE l-FRAME IN THE 
ORIGINAL MPEG-2 STREAM 
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( TRICK MODE STREAM^) 



181 



INPUT MPEG-2 TS FROM 
WHICH A TRICK MODE 
CLIP WILL BE EXTRACTED 



182 



VIDEO ELEMENTARY STREAM 
( VES ) EXTRACTED 



184 



I FRAME EXTRACTION AND 
VALID PES FORMATION 



183 



AUDIO ELEMENTARY STREAM 
(AES ) EXTRACTED 



187 



SELECTION AND CONCATENATION 
OF THE APPROPRIATE AUDIO ACCESS 
UNITS (FROM THE ORIGINAL ASSET) 
BASED ON THE STRUCTURE OF THE 
VES IN THE TRICK MODE CLIP AND 
VALID PES ENCAPSULATION AROUND 
THESE AUDIO ACCESS UNITS 
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SNR SCALING OF THE 
l-FRAMES-ONLY PES 
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FREEZE P FRAME INSERTION 
AND VALID PES FORMATION 
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TS STREAM GENERATION BY 
MULTIPLEXING THE ABOVE 
VIDEO PES INTO A SYSTEM 
INFO (SI) AND AUDIO PES 
CARRYING TS SKELETON 



( END ) 



Fig. 10 
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221 




■222 



REMOVE DCT COEFFICIENTS 
FOR SPATIAL FREQUENCIES 
IN EXCESS OF THE NYQUIST 
FREQUENCY FOR THE 
DOWNSAMPLED VIDEO 



NO 



YES 
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RETAIN UP TO A CERTAIN NUMBER OF 
LOWEST-ORDER AC DCT COEFFICIENTS 
FOR EACH BLOCK AND REMOVE ANY 
ADDITIONAL AC DCT COEFFICIENTS 
FOR EACH BLOCK 



■227 



RETAIN UP TO A CERTAIN NUMBER OF 
LARGEST MAGNITUDE AC DCT 
COEFFICIENTS FOR EACH BLOCK 
AND REMOVE ANY ADDITIONAL AC 
DCT COEFFICIENTS FOR EACH BLOCK 



■229 



RETAIN UP TO A CERTAIN NUMBER 
OF AC DCT COEFFICIENTS THAT 
DIFFER IN MAGNITUDE FROM UP 
TO THAT NUMBER OF LARGEST 
MAGNITUDE AC DCT COEFFICIENTS 
BY NO MORE THAN A CERTAIN LIMIT 



( RETURN P) 



Fig. 13 
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( FDSNR-LP ) 
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PARSE AND COPY THE DIFFERENTIAL 
DC COEFFICIENT VLC. 



—241 



LET L=0 



-242 



■243 



PARSE THE NEXT (RUN, LEVEL) EVENT VLC. 



244 




■245 



YES 



COPY 
VLC 



246 



NO 



LET R= RUN LENGTH OF ZEROES FOR 
THE CURRENT (RUN, LEVEL) EVENT 
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YES 



COPY EOB 
MARKER 
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NO 
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LET 

L=L+R+1 




YES 



COPY 
VLC 
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COPY 
VLC 
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254 — 



COPY EOB 
MARKER 



1. 1 



249 — 



PARSE UNTIL THE END OF THE NEXT EOB 
MARKER IN THE INPUT BIT STREAM 



Fig. 14 
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FDSNR-LM 
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PARSE AND COPY THE DIFFERENTIAL 
DC COEFFICIENT VLC 



— 261 



PARSE AND DECODE ALL ( RUN, LEVEL ) 
EVENT VLC S UNTIL AND INCLUDING 
THE FIRST EOB MARKER 



—262 



TRANSFORM THE QUANTIZATION INDICES 
TO QUANTIZED COEFFICIENT VALUES 



—263 



SORT THE COEFFICIENTS IN DESCENDING 
ORDER OF THEIR MAGNITUDES 



—264 



KEEP THE FIRST K COEFFICIENTS OF THE 
SORTED LIST AND SET THE LAST 63-K 
COEFFICIENTS OF THE SORTED LIST TO ZERO 



— 265 



APPLY ( RUN, LEVEL ) EVENT FORMATION AND ENTROPY 
ENCODING TO THE NEW SET OF COEFFICIENTS 



—266 



COPY THE RESULTING VLC s TO THE OUTPUT 
UNTIL AND INCLUDING THE EOB MARKER 



—267 
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Fig. 15 
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( SORT K FROM N ) 
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GET NEXT COEFFICIENT 
FROM INPUT STREAM 
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( RETURN ) 
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SORT THE 
LIST OF K 
COEFFICIENTS 
BY MAGNITUDE 




NO 



YES 



■285 



PUT COEFFICIENT 
INDEX AND MAGNITUDE 
INTO SORT LIST 



i + 1 —286 



288 



COEFFICIENT 
MAGNITUDE > MAGNITUDE 
AT END OF LIST 
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YES 
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NO 

r / — 


GET NEXT COEFFICIENT 
FROM INPUT STREAM 







■289 



NO 
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291 



REMOVE ENTRY AT THE 
END OF THE LIST 



■292 



BINARY SEARCH FOR RANK 
POSITION OF CURRENT 
COEFFICIENT 



■293 



INSERT CURRENT 
COEFFICIENT INDEX AND 
MAGNITUDE INTO THE LIST 
AT THE RANK POSITION 



Fig- 17 
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APPROXIMATE 
SORT K FROM 
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CLEAR HASH TABLE 
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GET NEXT 
COEFFICIENT FROM 
INPUT STREAM 
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EOB 
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YES 



NO 
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STRIP HASH TABLE 
INDEX FROM MSB S 
OF COEFFICIENT 
MAGNITUDE 



■315 



INSERT COEFFICIENT 
INDEX ON HASH 
LIST OF INDEXED 
HASH TABLE ENTRY 



Fig. 19 
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INDEX HASH 
TABLE WITH i 



318 




YES 



320 



319 



NO 



■321 



GET NEXT ENTRY FROM 
HASH LIST AND PUT 
COEFFICIENT IN THE 
OUTPUT STREAM 
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MODIFIED 
FDSNR-LM 



■331 



FIND UP TO k LARGEST MAGNITUDE NON-ZERO 
AC DCT COEFFICIENTS (i.e., THE "QUALIFYING 
COEFFICIENTS") FOR THE BLOCK 



■332 



■337 



BEGIN (RUN, LEVEL) 
CODING OF THE QUALIFYING 
COEFFICIENTS IN SCAN 
ORDER, USING THE SECOND 
CODING TABLE (TABLE 1) 



CONTINUE (RUN, LEVEL) 
CODING OF THE QUALIFYING 
COEFFICIENTS IN SCAN 
ORDER USING THE SECOND 
CODING TABLE 




336 



IF POSSIBLE, INCLUDE A NON-ZERO, 
NON-QUALIFYING AC DCT COEFFICIENT 
IN THE (RUN LEVEL) CODING TO 
ELIMINATE THE ESCAPE SEQUENCE 



■335 




( RETURN ) 



Fig. 20 



L_ 



18/24 



( ATTEMPT ELIMINATION OF ESCAPE SEQUENCE ^ 



■341 



IDENTIFY THE FIRST QUALIFYING 
COEFFICIENT AND THE SECOND 
QUALIFYING COEFFICIENT 
CAUSING THE ESCAPE SEQUENCE 



■342 



LOOK FOR A NON-ZERO, 
NON-QUALIFYING AC DCT 
COEFFICIENT BETWEEN THE 
FIRST AND THE SECOND 
QUALIFYING COEFFICIENTS IN 
THE SCAN ORDER SEQUENCE 
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ESCAPE 
SEQUENCE 
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YES 
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(RUN, LEVEL) CODE THE SECOND 


QUALIFYING COEFFICIENT, 


USING THE NEW RUN LENGTH 
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YES 




SEARCH FOR 
ADDITIONAL NON-ZERO 
NON-QUALIFYING 
COEFFICIENTS THAT 
WILL ELIMINATE THE 
ESCAPE SEQUENCE 




RETURN 
SUCCESSFUL 



351 



SELECT THE 
NON-QUALIFYING 
COEFFICIENT GIVING THE 
SHORTEST OVERALL 
CODE 'LENGTH AND/OR 
THE LARGEST MAGNITUDE 
FOR THE BEST PSNR 



RETURN 
SUCCESSFUL 
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READ IN TABLE 1 
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APPLY MODIFIED FDSNR-LM PROCEDURE, USING 
ADJUSTED QUANTIZER SCALE INDEX IF LESS THAN 
THE MAXIMUM POSSIBLE QUANTIZER SCALE INDEX 
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ATTEMPT RE-CODING FOR LAST 



SLICE USING ADJUSTED QUANTIZER 
SCALE AND SELECT NEW CODING OR 
CODING THAT GIVES BEST RESULTS 




ATTEMPT RE-CODING FOR LAST 
SLICE USING ADJUSTED k VALUE 
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1- Play from start 1 sec 

2- Pause 

3- Fast Forward to 29 min 
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